Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip intermittently failing tests #1987

Merged
merged 1 commit into from
May 1, 2023

Conversation

kaylareopelle
Copy link
Contributor

@kaylareopelle kaylareopelle commented May 1, 2023

The NewRelic::Agent::PipeChannelManagerTest has two cases failing on Ruby 2.5.9 and Rails 6.0/6.1:
#test_listener_merges_error_events, #test_listener_merges_error_traces

These tests started failing after PR#1969 was merged: #1969

The tests are now skipped in the specific conditions where they intermittently fail

This was tested locally using Ruby 2.5.9 and rails52 (where they should not be skipped), rails60, and rails61.

The NewRelic::Agent::PipeChannelManagerTest has two cases
failing on Ruby 2.5.9 and Rails 6.0/6.1:
#test_listener_merges_error_events, #test_listener_merges_error_traces

These tests started failing after PR#1969 was merged:
#1969

The tests are now skipped in the specific conditions where they
intermittently fail
skip if RUBY_VERSION == '2.5.9' &&
defined?(Rails::VERSION::STRING) &&
# version string starts with 6.0 or 6.1
Rails::VERSION::STRING =~ /\A6\.(0|1)/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given that there won't be a Rails 6.2, I think checking for Rails::VERSION::MAJOR and then doing Rails::VERSION::MAJOR == 6 would suffice. Given the context (test code only) there's no need to change it though.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this suggestion. I thought about that too, even though it seems unlikely/unprecedented 6.2 would ever come out, I figured it might be better to specify.

@kaylareopelle kaylareopelle merged commit 2011289 into dev May 1, 2023
@kaylareopelle kaylareopelle deleted the conditionally-skip-pipe-channel-manager-tests branch May 1, 2023 21:55
@github-actions
Copy link

github-actions bot commented May 1, 2023

SimpleCov Report

Coverage Threshold
Line 93.99% 93%
Branch 85.53% 85%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants